Measurement of synchronization properties in systems with different excitation levels 
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We devised a measure based on the distributions of relative event timings of two coupled units. 
The measure dynamically evaluates temporal interdependencies between the two coupled units. 
Using this we show that even in the event of symmetrical coupling, non-identical units (having 
different control parameters) have small but persistent shifts in their event timings that change 
dramatically with the relative properties of their internal trajectories. We link that finding with the 
activity dependent synaptic modification in the brain showing that internally or externally driven 
excitation levels of the neuron may determine direction of information processing in a network. 

PACS numbers: 87.18.Hf, 05.45.Xt, 87.17.Aa, 05.65.Tp, 87.19. La 



It is hypothesized that the temporal structure of ac- 
tivity in the brain can play a crucial role in information 
processing It was also established that relative tim- 
ings between the spiking of coupled neurons may lead to 
long- and/or short- term synaptic modifications |2|, y, |4jj . 
To be able to monitor successfully such spatio-temporal 
patterning in biological systems in general it is crucial to 
develop adequate methods to measure relative timings of 
the observed events. Any method designed for this pur- 
pose must be statistical, based on information obtained 
from many events but at the same time able to detect dy- 
namical changes in the system. We have developed such 
a measure that is based on the dynamical monitoring of 
entropy changes in relative firing patterns between two 
coupled units. We will refer to it as a conditional entropy 
(CE) since it is calculated based on the relative timings 
of the events of both coupled units. The relative timings 
measured for the two units are shown in Fig. 1. When 
the conditional entropy of the event timing pattern of 
unit 2 was calculated with respect to unit 1, we mea- 
sured the timings of events that occurred at unit 2 with 
respect to the last event of unit 1. Conversely when the 
conditional entropy of unit 1 with respect to unit 2 was 
calculated, we measured the event timing of unit 1 with 
respect to the last event of unit 2. The probability dis- 
tributions are dynamically updated (when the new event 




FIG. 1: Relative event timings used to calculate the condi- 
tional entropy. The timings of one unit (or neuron) are cal- 
culated in relation to the timing of the last event of the other 



takes place) by increasing the bin of the distribution in 
which the latest timing falls by a fixed AP. Thus, if the 
timing falls in the bin I, Pr(i) = Pj(t - 1) + AP. The 
distributions were then renormalizcd. Thus, the AP ef- 
fectively determines to what degree the distribution will 
be skewed towards the timings of the newest events, so 
that the probability of the event timing after n events 
declines to: 
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The entropies are calculated from the normalized distri- 
butions, S = — ^2 j Pi InP/, every time new events oc- 
cur. We applied the measure to monitor relative timing 
patterns of two coupled non-identical Rossler oscillators 
[51 and then two Hindmarsh-Rose models of the neurons 
[3 ■ The coupled units differed through the value of their 
control parameters that influence dynamical properties 
of their trajectories. In light of the second example we 
will relate to those properties as excitation levels. 

The event timings for the Rossler oscillator were de- 
fined as the times at which the oscillator's trajectory 
(unit 1 or 2) crosses specified Poincare section (z = 1). 
The equations for the coupled Rossler system are: 



ii,2 = -(zi,2 + 2/1,2) 

1/1,2 = £1,2 + 01,22/1,2 + "(1/2,1 

z\,2 = b+ (2:1,2 - c)zi 2 
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where the subscript denotes the oscillator number; ai,2, 
6 = 0. 2, c = 10.0 are the control parameters of the oscil- 
lators and a — 0.4 is the coupling. The values of param- 
eters a\ and a 2 were different for both units. 

We found that the measure highlighted an important 
result. The conditional entropy of the oscillator with 
higher excitation level (a larger control parameter, a,-) is 
close to zero, whereas the entropy of the oscillator with 
lower excitation is significantly higher (Fig 2A). More- 
over, a small change in the difference between the con- 
trol parameters that changes their relative excitation lev- 
els causes the conditional entropies to change rapidly. 
We applied the measure to coupled oscillators having 
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FIG. 2: Conditional entropy calculated for two Rossler oscil- 
lators with different relative excitation levels (value of 01,2). 
Panel A: the a± is varied from 0.1 to 0.4 and the control pa- 
rameter of unit 2 is fixed and 0,2 = 0.3. Panel B: is a grayscale 
map of the conditional entropy difference when both 01,2 are 
varied from 0.1 to 0.4. Panels C and D: The relative timings 
of the spikes for the two units when the excitation: C)ai > 02 
and D) a 2 > a 1 . 



parameter span an extended range of values (Fig 
2B); the observed phenomenon persisted over whole the 
range. Fig 2B plots grayscale map to represent the differ- 
ence between the conditional entropies (S\ — S2) for the 
full range of the parameters of both units; white denotes 
minimal value whereas black denotes the maximal one. 
The difference values do not change significantly except 
in the neighborhood of the diagonal (ai = 02), where 
S± = S2 = 0. As the diagonal is crossed the values of 
the entropies switch and thus their difference takes op- 
posite values. This is due to the fact that even though 
the coupling between the two units is symmetrical, there 
is asymmetry in the firing pattern that depends differ- 
entially on the relative excitation level of the coupled 
oscillators. That is, even if the firing seems to be coin- 
cident due to the coupling, the event timing of the unit 
that has higher excitation precedes narrowly that of the 
other unit. Fig 2C, D depicts this situation. We inte- 
grated the trajectories of the two oscillator for 5000s; at 
t = 2500 we changed the values of the control param- 
eters so that at t < 2500s, a\ < 0,2 and at t > 2500s 
a± > 0,2- We plot an example of the relative timing of 
the events of the two units for both regimes. Only at 
ai =0-2, the two units synchronize with zero time lag, 
making their conditional entropies equal and zero. Fig. 
3 shows the changes in the conditional entropies of the 
two units due to changes of relative values of the control 
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FIG. 3: The changes of conditional entropy are monitored 
during different phases of the same integration. The duration 
of the interaction was 16000 seconds and there were 5 intervals 
of 3000s each. The settings of every interval are listed above. 



parameter a. As the relative values of control parameter 
changes, the entropies change dramatically following the 
changes of the timing interdependencies of the two units: 
a = in I and V sections - the two units are independent 
and both have high conditional entropies; a = 0.4 and 
the a\ = a,2 in section II - the conditional entropies of 
both units decrease to zero; when the units have differ- 
ent relative excitation levels (sections III and IV), their 
conditional entropies start changing rapidly at the onset 
of the sections, with the conditional entropy of the unit 
with higher excitation level tending to zero, and that of 
the other one being high. 

We investigated the stability of the described phenom- 
ena for different values of coupling (Fig 4). As before, 
the control parameter of one unit was constant and that 
of the second unit was varied. When the coupling is 
equal to zero both oscillators are independent and their 
conditional entropies are high (Fig. 4A). However, the 
described timing interdependencies materialize even for 
small couplings. For a coupling as low as a = 0.2 the 
conditional entropies for both oscillators are significantly 
different (Fig. 4B). The conditional entropies Si = S2 
and are equal to zero only when both oscillators have the 
same values of their control parameters (Fig 4C). Thus, 
this is the only time when the two oscillators mutually 
synchronize. At larger couplings the events of the oscil- 
lator with higher excitation precede within the narrow 
window the ones of the oscillator with lower excitation 
(Fig. 4D). 

We also investigated the effects of noise on the rela- 
tive values of conditional entropies. A term of the form, 
A * ipi y 2 (t) was added to the y-coordinate of each of the 
oscillators. The amplitude, A, varied from to 10 and 
il>(t) G [ — 1, 1] was a randomly generated, uniformly dis- 
tributed, variable (different for both oscillators). The ob- 
served phenomenon was very robust with respect to noise 
(Fig. 5). The noise effectively destroyed the synchro- 
nization at the point where the control parameters of the 
oscillators were equal (Fig. 5B-D). This is due to the fact 
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FIG. 4: The changes of the conditional entropy in the presence 
of coupling of different strengths. The control parameter ai 
was varied from 0.1 to 0.4, 02 = 0.3 and was fixed. The 
coupling strength a is denoted on top of every panel. 




FIG. 5: Stability of the relative event timings in the presence 
of noise. The conditional entropy is measured for the varying 
relative excitation levels of Rossler oscillators. The noise level 
is marked on each panel. 



that at this point the noise induced jitter in the timings 
of the events causing the same oscillator to sometimes 
precede and sometimes follow the other one. However, 
the salient features of the behavior remain the same: the 
unit with the higher excitation level always fires in a nar- 
row window before the one with the lower excitation level 
and thus the timing interdependencies remain unchanged 
when the control parameters are different. Thus, when 
the excitation levels of the oscillators are different, the 
conditional entropy of the unit with higher excitation is 
close to zero, whereas that of the other oscillator is high. 

We show that the same phenomenon can be observed 
for a system of two interacting Hindmarsh-Rose models 
of the neuron. The equations for the coupled Hindmarsh- 
Rose neurons are: 

£1,2 = 2/1,2 - ax\.2 + bx\ 2 - z lf2 + hi,2 + a(x2,i - 2:1,2) 

2/1,2 = c - dx\ 2 - y 1>2 

z\,2 = r [s(xi,2 - x ) - zi,a] 

(3) 

where the subscript denotes the neuron number; a = 1.0, 
b = 3.0, c = 1.0, d = 5.0, r = 0.006, s = 4.0, and 
xq = —1.6 are the parameters of the model and a = 1.1 
is the coupling strength. The parameter Iq represents 
the amplitude of internal current to the neuron and is 
the control parameter of the system. We performed mea- 
surement of conditional entropy for two coupled neurons. 
Here, the event timings were the timings of spikes emit- 
ted by the neurons. The excitation levels of the two neu- 
rons varied (Fig 6). The conditional entropies changed 
in the same manner as in the case of the Rossler oscilla- 
tors. That is the conditional entropy of the neuron with 



the higher excitation level was zero and that of the other 
neuron is significantly higher (Fig. 6A, B). This sug- 
gests that the behavior is quite general and not limited 
to purely theoretical models. As in the case of the Rossler 
oscillators, these dramatic changes in the CEs were due 
to the fact that the neuron with the higher excitation 
(i.e., higher I ) fired a spike in a narrow window before 
the neuron with the lower excitation (Fig. 6C, D). 

These results imply that a link can be made between 
levels of excitation and the dramatic changes in the spike 
timing interdependencies of the coupled neurons. The 
small shifts observed and measured may have big impli- 
cations in connection to experimentally observed activity 
dependent synaptic modification. Experimentally mea- 
sured synaptic Long Term Potentiation (LTP) and Long 
Term Depression (LTD) as well as short term changes 
are directly linked to the relative timings of the emitted 
spikes If the presynaptic neuron emits a spike in 

a narrow window before the postsynaptic neuron the con- 
necting synapse (and in some cases other synapses) will 
be potentiated. Conversely, if the postsynaptic neuron 
fires systematically before the presynaptic neuron the re- 
lated synapses will be depressed. We, on the other hand 
show that relative spike timings depend upon the rela- 
tive level of excitation between the neurons in question. 
Thus we established a possible link between the relative 
levels of excitation of the neurons themselves and the 
pattern of synaptic modifications. Furthermore, we can 
postulate that since the synaptic modifications will de- 
pend differentially on the relative excitation levels of the 
coupled neurons, the direction of information processing 
will be directly linked to them: neurons having higher 
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FIG. 6: Conditional entropy calculated for two Hindmarsh- 
Rose neurons with different relative excitation levels (value 
of Ioi, 2). Panel A: Toi is varied from 1.32 to 3.4 and the 
control parameter of neuron 2 is fixed at I02 = 2.5. Panel B: 
a grayscale map of the conditional entropy difference when 
both 7oi,2 are varied from 1.32 to 3.4. Panels C and D: The 
relative timings of the spikes for the two neurons when the 
excitation is: C) Ioi > I02 and D) /02 > Iai. 



excitation levels will effectively drive the neurons with 
lower excitation levels, since this monosynaptic pathway 
will be potentiated. Since it is known that those levels 
of excitation can be controlled intrinsically by neurons 
(through expression of appropriate receptors) [7J, or ex- 
ternally through the signal arriving at the given neuron, 
this implies that the directionality of information pro- 
cessing can be dynamically controlled by the informa- 
tion itself. We implement this hypothesis on a model of 
two coupled neurons, with non-symmetrical modifiable 
couplings. Changes in the coupling strengths, ev.1,2, of 
both neurons are linked to their respective conditional 
entropies. The general form of those changes is given 
by: a\ 2{S) = irf , where A = 1.1 and (3 — 5.0 are 

constants. Initially the neurons have the same coupling, 
but different control parameters, Iqi and 7o2- The cou- 
pling u\ (driven by the value of conditional entropy) from 



the neuron with higher excitation level got progressively 
stronger whereas that of the other one became signifi- 
cantly smaller until a steady state was reached, where 
u\ achieved its maximal value and ui decreased to its 
minimal one. At t=3000ms the control parameter of the 
neurons was switched, so that the neuron with the pre- 
viously lower excitation level now had a higher one. The 
change evoked rapid synaptic modifications (changes in 
the coupling strength a-\ 2) driven by the changing con- 
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FIG. 7: Simulation of the modifiable non-symmetrical cou- 
pling between the neurons with changing excitation levels. 
The information flow reverses itself as the relative excitation 
levels are changed: A) conditional entropies and B) coupling 
strengths. 



ditional entropies. When steady state was reached again 
the synapses effectively switched their efficacy (the values 
of ai t 2 had reversed). Thus the neuron that was initially 
driven became a driver (Fig. 7A, B) - the information 
flow is reversed. 

In conclusion, we have constructed a measure that 
monitors dynamically changing distributions of event 
timings of two coupled units. The use of this measure 
led to discovery of a relation between the event timings 
of two coupled units with different values of control pa- 
rameters (i.e. excitation levels) . The event timings of the 
unit with higher excitation level happen within a narrow 
window before those of the other unit. We have shown 
this phenomenon on two different systems: Rossler oscil- 
lators and Hindmarsh-Rose models of the neurons. We 
believe that the observed phenomenon together with the 
known experimental results of activity dependent synap- 
tic modification may provide an important link between 
dynamic modifications of the network during the infor- 
mation processing and the content of the processed in- 
formation itself. The obtained results have to be now 
investigated experimentally. 
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